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(57) Abstract 

An integrated control 
system comprises one 
or more controllers each 
equipped to perform a 
control function and to 
gather data (ordinarily 
from sensors or a video 
camera) relevant to the 
control function. Each 
controller contains computer 
storage means, such as 
computer memory, for 
storing the relevant data 
and instructions, associated 
with the data, for causing 
a remote computer to 
generate a visual display 
incorporating the data in 
a predetermined format; 
and a communication 
module for establishing 
contact and facilitating data 
interchange with the remote 
computer. The remote 
computer, in turn, also 
includes a communication 
module compatible' with 

the controller-borne module, and which enables the remote computer to download the data, including current video information and/or 
historical and/or reference video information, and associated instructions from one or more controllers. The remote computer also includes 
a facility for processing the instructions to create a user interface encoded by the instructions, and which incorporates the data. In this 
way, controller data is coupled to instructions for displaying that data, and this totality of information is continuously accessible, on a 
freely selective basis, to the remote computer. 



FOR THE PURPOSES OF INFORMATION ONLY 
Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL 


Albania 


ES 


Spain 


LS 


Lesotho 


SI 


Slovenia 


AM 


Armenia 


FI 


Finland 


LT 


Lithuania 


SK 


Slovakia 


AT 


Austria 


FR 


France 


LU 


Luxembourg 


SN 


Senegal 


AU 


Australia 


GA 


Gabon 


LV 


Latvia 


sz 


Swaziland 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Herzegovina 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


Togo 


BB 


Barbados 


GH 


Ghana 


MG 


Madagascar 


TJ 


Tajikistan 


BE 


Belgium 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turkmenistan 


BF 


Burkina Faso 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


BG 


Bulgaria 


HU 


Hungary 


ML 


Mali 


TT 


Trinidad and Tobago 


BJ 


Benin 


IE 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


IL 


Israel 


MR 


Mauritania 


UG 


Uganda 


BY 


Belarus 


IS 


Iceland 


MW 


Malawi 


US 


United States of America 


CA 


Canada 


IT 


Italy 


MX 


Mexico 


UZ 


Uzbekistan 


CF 


Central African Republic 


JP 


Japan 


NE 


Niger 


VN 


Viet Nam 


CG 


Congo 


KE 


Kenya 


NL 


Netherlands 


YU 


Yugoslavia 


CH 


Switzerland 


KG 


Kyrgyzstan 


NO 


Norway 


ZVV 


Zimbabwe 


CI 


Cdte d'lvoire 


KP 


Democratic People's 


NZ 


New Zealand 






CM 


Cameroon 




Republic of Korea 


PL 


Poland 






CN 


China 


KR 


Republic of Korea 


FT 


Portugal 






CU 


Cuba 


KZ 


Kazalcstan 


RO 


Romania 






CZ 


Czech Republic 


LC 


Saint Lucia 


RU 


Russian Federation 






DE 


Germany 


LI 


Liechtenstein 


SD 


Sudan 






DK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapore 








WO 98/50834 




PCT/US98/09226 



1 



DISTRIBUTED INTERFACE 
ARCHITECTURE FOR PROGRAMMABLE 
INDUSTRIAL CONTROL SYSTEMS 

Cross Reference to Related Application 

This is a continuation-in-part of Application Serial No. 08/655,469, 
filed May 30, 1996. 

FIELD OF THE INVENTION 

5 The present invention relates to industrial automation, and in 

particular to communication with and among programmable controllers 
for operating and monitoring industrial processes and equipment. 

BACKGROUND OF THE INVENTION 

Sophisticated industrial processes, such as oil refining, automobile 
10 assembly or power generation, require the cooperative execution of 

numerous interdependent tasks by many different pieces of equipment. 
The enormous complexity of ensuring proper task sequencing and 
management, which requires not only procedural logic but constant 
monitoring of equipment states to organize and distribute operations and 
15 detect malfunction, has resulted in the widespread adoption of 

programmable controllers. These controllers operate elaborate industrial 
equipment in accordance with a stored control program. When 
executed, the program causes the controller to examine the state of the 
controlled machinery by evaluating signals from one or more sensing 
20 devices (e.g., temperature or pressure sensors), and to operate the 

machinery (e.g., by energizing or de-energizing operative components) 
based on a procedural framework, the sensor signals and, if necessary, 
more complex processing. The ''inputs" to a particular controller can 
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extend beyond the sensed state of the equipment the controller directly 
operates to include, for example, its environment, the state of related 
machinery or the state of its controllers. 

Control requirements become even more complex when different 
5 aspects of the same overall process are assigned to remotely situated 
equipment. Such configurations often require reliable, high-bandwidth 
serial communication links to provide the necessary interconnection and 
handle data transfer among controllers and the sensors relevant to their 
operation. 

Ordinarily, process operation is monitored, at least intermittently, 
by supervisory personnel by means of one or more central management 
stations. Each station samples the status of controllers (and their 
associated sensors) selected by the operator and presents the data in 
some meaningful format. The management station may or may not be 
located on the same site as the monitored equipment; frequently, one 
central station has access to multiple sites (whether or not these perform 
related processes). Accordingly, communication linkage can be vital 
even in traditional industrial environments where process equipment is 
physically proximate, since at least some supervisory personnel may not 
be. 

To facilitate the necessary communication, the controller 
processors and related computers (such as monitoring stations) are 
arranged as a computer network. A network, basically, is a collection of 
interconnected computers that use some consistent protocol to 
communicate with one another. Typically, the network is organized such 
that any computer may communicate with any other network computer. 
The communication protocol provides a mechanism by which messages 
can be decomposed and routed to a destination computer identified by 
some form of address. The protocol may place a "header" of routing 
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information on each component of a message that specifies source and 
destination addresses, and identifies the component to facilitate later 
reconstruction of the entire message by the destination computer. This 
approach to data transfer permits the network to rapidly and efficiently 

5 handle large communication volumes without reducing transfer speed in 
order to accommodate long individual messages, or requiring every 
network computer to process every network message. The degree of 
routing depends on the size of the network. Each computer of a local 
network typically examines the header of every message to detect 

10 matches to that computer's identifier; multiple-network systems use 
routing information to first direct message components to the proper 
network. 

Controllers have been interconnected by means of computer 
networks for some time; see, e.g., U.S. Patent No. 5,307,463. In typical 

15 systems, a monitoring computer, which may be remotely located from 
any or all of the controllers to which it has access, periodically queries 
the controllers to obtain data descriptive of the controlled process or 
machine, or the controller itself. This data is then available for analysis 
by the monitoring computer. Heretofore, however, the type of 

20 information obtainable, on demand, from a controller has been limited, 
while the interface used to present the information on the monitoring 
computer is typically crude. The latter condition results from the 
multiplicity of data types offered by the controller. Were each type of 
data to be rendered in a format suited to that data, it would be necessary 

25 to equip the monitoring computer with multiple interfaces, and configure 
the operating application to ascertain the type of data before selecting 
and launching the proper interface. Not only does this scheme impose a 
substantial real-time support burden on the monitoring computer, but 
would also require a constantly expanding repertoire of graphical 

30 capabilities keyed to new forms of data reported by the controllers. This 
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can be especially cumbersome in highly — even internationally — 
distributed environments, since the controllers and their functionalities 
may be programmed by personnel having no contact with those 
responsible for central monitoring. 



Brief Summary of the Invention 

The present invention utilizes the capabilities of the Internet and, 
more particularly, the interactive capabilities made available by resources 
such as the World Wide Web to shift the burden of providing user 

10 interfaces for changing forms of data from monitoring computers to the 
controllers that actually gather and report the data. By combining data 
with functionality for displaying that data at the individual controller sites, 
the need to equip monitoring computers with specialized graphic 
capabilities is eliminated, along with the need for intensive, ongoing 

15 cooperation between engineers responsible for programming controllers 
and those who configure the computers that perform monitoring. 
Moreover, because Internet users are typically billed for connectivity at a 
single rate, the long-distance charges that would accrue through use of 
telephone lines for data communication are eliminated. 

20 In accordance with the invention, an integrated control system 

comprises one or more controllers each equipped to perform a control 
function and to gather data (ordinarily from sensors) or visual information 
(e.gr., from a video camera) relevant to the control function. "Relevant" 
data includes, at a minimum, any information upon which control 

25 decisions are made or states shifted, but can also include information 
obtained from sensors not directly connected to the controller (e.g., 
involving other controlled machines) but which is nonetheless meaningful 
to supervisory personnel. For example, a chemical synthesis process 
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may be carried out at a temperature controlled to stay within an 
operating range, but the optimal temperature may depend on the output 
of a previous process feeding into the synthesis; in this case, the 
temperature of the synthesis process as well as the output of the 

5 previous process are relevant control parameters with respect to the 
synthesis process. Visual information may include real-time video or 
periodically sampled images of control panels, gauges indicating a 
parameter such as temperature, indicator lights or, most usefully, 
portions of the controlled equipment itself. In addition, a file which may 

10 be contained, for example, in the web page of the video transmission site 
computer, can include previously stored video data for comparison with 
current video data. For example, the stored data may be historical data 
comprising previously recorded video images of machine conditions at an 
earlier time, or may instead comprise reference images showing, for 

15 example, normal machine operation. 

Each controller contains computer storage means, such as 
computer memory (volatile and/or non-volatile, such as random-access 
memory ("RAM"), programmable read-only memory ("ROM") or Flash 
ROM), or a mass storage device such as a hard disk or CD-ROM, for 

20 storing the relevant data and instructions, associated with the data, for 
causing a remote computer to present the data (e.g., by generating a 
visual display incorporating the data) in a predetermined format; and a 
communication module for establishing contact and facilitating data 
interchange with the remote computer. The remote computer, in turn, 

25 also includes a communication module compatible with the controller- 
borne module, and which enables the remote computer to download the 
data and associated instructions from one or more controllers. The 
remote computer also includes a facility for processing the instructions to 
create a user interface — that is, a visual display, which may include 

30 video and/or graphics, or other presentations having a predetermined 
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format encoded by the instructions, and which incorporates the data or 
otherwise enables the monitoring engineer to gain as much information 
about the controller as possible. In this way, controller data is coupled to 
instructions for presenting that data, and this totality of information is 
5 continuously accessible, on a freely selective basis, to the remote 
computer. 

It should be stressed that the system may include more than one 
remote monitoring computer, and any of these may not, in fact, be 
"remote" (in terms of distance) at all; instead, they may reside at the 
10 same site as the controlled process or equipment. Ordinarily, the 

monitoring computer or computers operate as peers with respect to the 
controllers on a flat network topology. 

The invention facilitates a complete window into the operation of 
one or more controllers and, therefore, the industrial equipment they 

15 operate. Using the invention, remotely located personnel can monitor the 
efficiency or overall behavior of the equipment, visually check machine 
components, workpieces, or other critical components of the controlled 
system. Additionally, the monitoring engineer can perform diagnostic 
checks, or even effect certain maintenance operations. For widely 

20 dispersed control and supervisory operations, supervisory computers 
interact with the controllers over the Internet, with the controllers 
continuously connected to the Internet as "nodes/' In local operations, 
the flexibility conferred by Internet formalisms can be retained on a 
restricted, internal network. 

25 Brief Description of the Drawings 



The foregoing discussion will be understood more readily from the 
following detailed description of the invention, when taken in conjunction 
with the accompanying drawings, in which: 
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FIG. 1 schematically depicts a controller in accordance with the 
present invention; and 

FIG. 2 schematically depicts a system incorporating multiple 
controllers as shown in FIG. 1 and a browser-equipped computer 
5 capable of accessing data associated therewith. 

Detailed Description of the Preferred Embodiments 

The Internet, which can provide the communication medium of the 
present invention, is a worldwide "network of networks" that links 
millions of computers through tens of thousands of separate (but 
10 intercommunicating) networks. Via the Internet, users can access 

tremendous amounts of stored information and establish communication 
linkages to other Internet-based computers. 

Much of the Internet is based on the client-server model of 
information exchange. This computer architecture, developed specifically 

15 to accommodate the "distributed computing" environment that 

characterizes the Internet and its component networks, contemplates a 
server (sometimes called the host) - typically a powerful computer or 
cluster of computers that behaves as a single computer -- that services 
the requests of a large number of smaller computers, or clients, which 

20 connect to it. The client computers usually communicate with a single 
server at any one time, although they can communicate with one another 
via the server or can use the server to reach other servers. A server is 
typically a large mainframe or minicomputer cluster, while the clients may 
be simple personal computers. Servers providing Internet access to 

25 multiple subscriber clients are referred to as "gateways"; more generally, 
a gateway is a computer system that connects two computer networks. 

In order to ensure proper routing of messages between the server 
and the intended client, the messages are first broken up into data 
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packets, each of which receives a destination address according to a 
consistent protocol, and which are reassembled upon receipt by the 
target computer. A commonly accepted set of protocols for this purpose 
are the Internet Protocol, or IP, which dictates routing information; and 
5 the transmission control protocol, or TCP, according to which messages 
are actually broken up into IP packets for transmission for subsequent 
collection and reassembly. TCP/IP connections are quite commonly 
employed to move data across telephone lines. 

The Internet supports a large variety of information-transfer 

10 protocols. One of these, the World Wide Web (hereafter, simply, the 
''web"), has recently skyrocketed in importance and popularity; indeed, 
to many, the Internet is synonymous with the web. Web-accessible 
information is identified by a uniform resource locator or "URL," which 
specifies the location of the file in terms of a specific computer and a 

15 location on that computer. Any Internet "node" - that is, a computer 
with an IP address (e.g., a server permanently and continuously 
connected to the Internet, or a client that has connected to a server and 
received a temporary IP address) - can access the file by invoking the 
proper communication protocol and specifying the URL. Typically, a URL 

20 has the format http://<host>/<path> , where "http" refers to the 

HyperText Transfer Protocol, "host" is the server's Internet identifier, and 
the "path" specifies the location of the file within the server. Each "web 
site" can make available one or more web "pages" or documents, which 
are formatted, tree-structured repositories of information, such as text, 

25 images, video, sounds and animations. 

An important feature of the web is the ability to connect one 
document to many other documents using "hypertext" links. A link 
appears unobtrusively as an underlined portion of text in a document; 
when the viewer of this document moves his cursor over the underlined 
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text and clicks, the link — which is otherwise invisible to the user — is 
executed and the linked document retrieved. That document need not be 
located on the same server as the original document. 

Hypertext and searching functionality on the web is typically 

5 implemented on the client machine, using a computer program called a 
"web browser." With the client connected as an Internet node, the 
browser utilizes URLs -- provided either by the user or a link — to locate, 
fetch and display the specified documents. "Display" in this sense can 
range from simple pictorial and textual rendering to real-time playing of 

10 audio and/or video segments or alarms, mechanical indications, printing, 
or storage of data for subsequent display. The browser passes the URL 
to a protocol handler on the associated server, which then retrieves the 
information and sends it to the browser for display; the browser causes 
the information to be cached (usually on a hard disk) on the client 

15 machine. The web page itself contains information specifying the 

specific Internet transfer routine necessary to retrieve the document from 
the server on which it is resident. Thus, clients at various locations can 
view web pages by downloading replicas of the web pages, via 
browsers, from servers on which these web pages are stored. Browsers 

20 also allow users to download and store the displayed data locally on the 
client machine. 

Most web pages are written in HyperText Markup Language, or 
HTML, which breaks the document into syntactic portions (such as 
headings, paragraphs, lists, etc.) that specify layout and contents. An 
25 HTML file can contain elements such as text, graphics, tables and 
buttons, each identified by a "tag." Markup languages, however, 
produce static web pages. 

Recent innovations have allowed web-page designers to overcome 
the static page appearance dictated by HTML. The Java language is a 
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well-known, machine-independent, interpreted computer language that 
facilitates dynamic display of information. Java-encoded "applets" are 
stand-alone programs embedded within web pages that can interact with 
the user locally, display moving animations and perform other functions 
5 on "Java-capable" browsers -- that is, browsers which include a Java 
interpreter. The applet is transferred to the browser along with other 
web-page information and is executed by the Java interpreter; the data 
acted upon by the applet can be located on the same or a different web 
page, or a different server entirely, since applets can themselves cause 
10 the browser to retrieve information via hypertext links. 

ActiveX controls represent an alternative to Java, although they 
typically require compatible browsers and computers. These programs 
can be written in many computer languages (including Java) and usually 
compile to machine code, in which case they operate only in conjunction 
15 with browsers running machines with appropriate processor 

architectures. Some languages, however, will compile to machine- 
independent byte codes, which can run on a variety of processor 
architectures. 

Suppose, for example, that a client user instructs the client- 
20 resident browser to obtain a document having the URL 

hitp .//host/file. html. The browser contacts the HTTP server running on 
"host," and requests the document file.html. The server finds this 
document and sends it according to the proper Internet protocol, along 
with a Multipurpose Internet Mail Extension or "MIME" identifier that 
25 specifies the document's type. When the client receives the document, 
the browser examines the MIME to determine whether it is capable of 
autonomously displaying the document, or whether an external resource 
(e.g., a specialized viewer to display video segments) is necessary. In a 
simple case, the document might contain text and graphics specified in 
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HTML, and specify an image residing in a different file on a different 
server or on the same server. The browser renders the document in 
accordance with the HTML instructions and requests the image, 
displaying it in the document as specified by the instructions when the 
5 image arrives. In more complex cases the document may contain, for 
example, Java instructions, which are passed to the browser's Java 
interpreter. 

Key to the concept of a web page, therefore, is the division of 
functionality between the client-based browser and the server-based web 
10 page, and the particular roles assigned to each. The browser locates, 
fetches and displays resources, executes hyperlinks and applets, and 
generally interprets web-page information; the web page contains data, 
hyperlink addresses, transfer protocols and computer instructions 
defining "potential functionality" that may be executed by the browser. 

15 Ordinarily, web pages reside on servers accessible via the Internet. 

However, the above-discussed mode of splitting functions between web 
pages and browsers can be instituted on internal networks as well. 
These networks, sometimes called "intranets," support the TCP/IP 
communication protocol and typically serve the needs of a single 

20 business (or business department), which may be located at a single site 
(with individual clients connected by a simple local-area network) or 
multiple physically dispersed sites requiring a wide-area network but not 
access to the Internet. Various of the computers forming the intranet 
network can be utilized as servers for web pages, each with its own URL 

25 and offering access to network client computers via TCP/IP. A custom 
"web page" can be written for the controller in such an intranet. In such 
a case, JAVA applet software, or similar executable code, can be 
employed to design a page or screen providing a menu containing a 
variety of monitoring tools for the system. Various monitoring functions 
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can be executed by the controller when these monitoring tools are 
selected in accordance with a predetermined protocol or as selected by a 
monitoring engineer. 

The manner in which this divided functionality can be incorporated 
5 into a bank of controllers and a monitoring system is illustrated in FIGS. 1 
and 2. With reference, first, to FIG. 1, a representative controller 
architecture is shown generally at 10. The controller 10 executes 
program instructions to operate, for example, a piece of industrial 
equipment, and includes a central processing unit ("CPU") 12 and one or 

10 more computer storage devices indicated generally at 14. Ordinarily, 
storage device 14 is composed of a combination of volatile RAM for 
temporary storage and processing, and non-volatile, programmable read- 
only memory ("PROM") that contains permanent aspects of the 
controller's operating instructions; however, computer storage 14 can, if 

15 desired, include mass-storage facilities such as a hard disk, CD-ROM 
drive, etc. Such on-board devices are useful if web pages or security 
features are expected to change frequently. 

CPU 12 and computer storage 14 communicate over an internal 
system bus 16. The system further includes a series of input/output 
20 modules shown representatively at 20i, 20 2 that sense the condition of, 
and send control signals to, the controlled machine over a communication 
link (indicated by arrows). This communication link facilitates the bi- 
directional exchange of signals between each I/O module and an 
associated device (e.g., a sensor or an actuator). 

25 In addition, the system includes video block 21 and a video camera 

(or a bank of video cameras) denoted generally at 21a. These are 
preferably digital video cameras associated with the monitored equipment 
which are directed at those portions of the monitored equipment which 
contain relevant visual information, such as operative machine 
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components from which the position or status of a workpiece can be 
verified. Video block 21 contains appropriate, conventional, circuitry for 
digitizing still images captured by video camera assembly 21a or for 
transmitting full motion video signals received from camera 21a as 

5 streaming video over the Internet as part of a web site, for example, by 
way of any other suitable communication channel. In addition, video 
block 21 will be responsive to commands issued by a remote computer 
which commands may include: selection of a particular camera from the 
bank of video cameras, changing the orientation of a camera, altering the 

10 video image capture rate of a particular camera, and/or responding to 
instructions regarding how the video information is to be transmitted. 
The signals from such a video camera assembly 21a will be an additional 
input to I/O bus 22 as shown in FIG. 1, or, optionally, to a separate high 
bandwidth bus 31 for communication to the network interface 30 (for 

15 high bandwidth transmission of data to a network-based host). 

I/O modules 20, as well as a network interface 30 that connects 
the controller 10 to a computer network, reside on or define a secondary 
I/O bus 22, which is driven by a bus transceiver 32; in effect, buses 16, 
22 and bus transceiver 32 form a single logical bus. The computer 

20 network may be a local-area network of machines communicating via, for 
example, the Ethernet protocol, or a direct link to the Internet. In a local- 
area network, the computers can implement TCP/IP over the low-level 
Ethernet hardware-management routines to create an intranet, or can 
instead (or in addition) be tied into the Internet as a node via, for 

25 example, telephone hookup to an external host computer serving as a 
commercial Internet provider. 



Storage 14 contains a series of functional blocks or modules that 
implement the functions performed by controller 10 through operation of 
CPU 12. A control block 35 contains instructions for operating I/O 
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modules 20. These instructions are read in rapid sequence and 
interpreted to examine the condition of selected sensing devices 
associated with the controlled equipment, and, based thereon, to cause 
the controller to send appropriate operative control signals to the 
5 equipment. Typically, the instructions are written in a relatively high- 
level language that permits not only manipulation of input and output 
data, but also arithmetic and timing functions, file-handling capabilities 
and other complex tasks. These instructions are translated into machine- 
readable code by means of an interpreter. For example, one standardized 

10 type of instruction symbolically represents control functions according to 
a relay ladder diagram; it is preferred, however, to utilize state-control 
languages that represent controller actiohs in terms of steps, each of 
which consists of a command that creates action and one or more 
instructions for leaving the step. Interpreters for these and other types 

15 of controller languages are well characterized in the art. See, e.g., U.S. 
Patent Nos. 5,321,829 and 5,287,548 (the entire disclosures of which 
are hereby incorporated by reference) and the QUICKSTEP™ User Guide 
published by Control Technology Corporation, Hopkinton, MA. Control 
block 35 contains both the specific high-level instructions for operating 

20 the controller 10 and the interpreter module for translating these into 
instructions processed by CPU 1 2; its operative relationship to I/O 
modules 20 is indicated by the dashed line. 

A network communication block provides programming to operate 
local-area network hardware and/or to connect with a remote network or 
25 network host. In the latter case, communication module 37 drives a 

modem within network interface 30 or other data-transmission circuitry 
to transfer streams of digitally encoded data over telephone or other 
communication lines. 

Storage 14 also contains data structures defining one or more web 
30 pages shown representatively at 40i, 40 2 . The web pages 40 consist of 
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ASCII data obtained from one or more of I/O modules 20, HTML 
formatting instructions and associated data, "applet" instructions that 
cause a properly equipped remote monitoring computer 50 (FIG. 2) to 
display the data in a dynamic fashion, or hyperlinks to other web pages, 

5 objects or applets . For example, an applet might cause temperature 

data to be displayed as a graphical representation of a thermometer, with 
the height of the rendered mercury column dynamically varying in 
proportion to the data from I/O modules 20 (and constantly provided to 
the remote computer via network interface 30); pressure data might be 

10 represented in the form of a graphically rendered needle-type pressure 
gauge. Such renderings and the integration of data therein are 
straightforwardly implemented by those skilled in the art (and familiar, for 
example, with the Java language) without undue experimentation. 

In accordance with the invention, web pages for the monitoring 
15 computer, or other remote computer in the control system, can be 

constructed to additionally display video information. Digital cameras 
(for example, which are available in miniature sizes and may operate on a 
12 volt DC power supply), readily allow still image capture. Digital 
cameras capture images on a charge-coupled device, which images are 
20 then downloaded onto the RAM storage of the camera. Pictures may be 
transferred from the video camera assembly 21a and video block 21 to 
the monitoring computer 50 (FIG. 2) by way of the network interface 30 
under command of the JAVA applet or other appropriate software for 
image reconstruction on the display monitor being used. Images can be 
25 downloaded from the camera to the controller computer and can be 
refreshed, as desired, with each download. Full motion video is readily 
achievable through use of appropriate video cameras in camera 
assembly 21 a. 
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The resultant video information can then be transmitted from the 
controller 10 back to the monitoring computer 50, in the manner desired. 
For example, individual images or full motion video can be transferred 
back across the Internet to the web page of the monitoring computer 
5 50. It is also possible to provide for switching between presentation 
formats, e.gr.,from periodically refreshed still images to full motion video 
(typically in response to instructions issued by the monitoring computer). 
This may be useful, for example, in the case of a military installation or a 
nuclear site. Appropriate circuitry for accomplishing this switching will 
10 be provided in video block 21, as desired, in the particular application as 
will be understood by those skilled in the art. 

A bank of video cameras can be arranged to provide alternative 
views of the monitored equipment, the monitoring computer or other 
meaningful visual information. When assessing operation of the 

15 controlled system, the monitoring engineer may select which video 

camera image from the images captured by the video camera bank is to 
be displayed, as well as the length of time such display is desired. The 
monitoring engineer scanning the video/graphic display may decide, for 
example, to make an adjustment to the equipment and to check visually 

20 to ascertain whether the expected response or event has occurred at the 
remote machine or in the remote process in response to the adjustment. 
Alternatively, database storage of the images can be provided to 
facilitate subsequent display of one or more images as part of the control 
sequence. 

25 Moreover, historical and/or reference video data may be stored 

within, for example, a file contained in a web page of the computer at 
the video transmission site. As stated earlier, historical video data shows 
machine operation at an earlier time, while reference video data shows 
normal machine operation. This previously stored data may be selected 
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for presentation by a remote operator for comparison with current video 
images {e.g., in a side-by-side window configuration for simulataneous 
presentation, which may also include a graphic frame illustrating a 
selected control or comparison parameter). 

5 Accordingly, the present invention permits a remote operator to 

visually check a portion of the controlled equipment to verify that the 
machine is operating in accordance with the data being received. For 
example , a command for controller actuation of a piston may be given 
and a video camera can be used to verify that the piston has been 

10 actuated. Additionally, a video camera can transmit images of gauges 
for verification that a control parameter conforms to data received from 
the controlled system, or that a circuit breaker has opened and a portion 
or all of the system has been shut down. As will be understood by one 
skilled in the art, there are any number of useful visual checks that can 

15 be performed by a monitoring engineer with respect to the controlled 
system using the video information obtained in accordance with the 
invention. 

Referring again to FIG. 1 , management and transmission of web 
pages 40 to a querying computer is handled by a web server module 45, 
20 which allows controller 10 to function as a network server. Once again, 
the features of this module are conventional in the art; see, e.g., Yuval 
Fisher, Spinning the Web (Springer 1996). 

Incoming data from I/O modules 20 may be processed by control 
block 35 before being copied into one of the web pages 40. Because of 
25 the linking capabilities of the web, it is not necessary for the data to be 
stored in the web page containing the display instructions; instead, the 
latter page may contain a "hyperlink" pointer to a different web page in 
which data is accumulated. In addition, a web page can obtain data from 
other web pages (e.g., from different controllers) by accessing those web 
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pages when appropriate. For example, if a cluster of controllers is 
operationally related such that data from one is usefully combined with 
data from the others, each page of the cluster can contain instructions to 
access the other pages (or their associated data pages) when accessed 
5 by a user, and the applet configured to present data from the entire 

cluster. Alternatively, the applet can be configured to cause the client's 
browser to access the web page. As used herein, data is "associated 
with" a web page or an applet if it is stored as part of the web page or 
applet, or stored in a directly or indirectly hyperlinked web page. 

10 Refer now to FIG. 2, which illustrates the manner in which multiple 

versions of the controller 1 0 are linked and queried by one or more 
monitoring computers. The querying computer 50, which functions as a 
network client, may be, for example, a personal computer running the 
Windows graphical user interface supplied by Microsoft Corp. Computer 

15 50 includes a network interface 52, which facilitates connection to and 
data transfer through a computer network 55 (which may, again, be a 
local network, the Internet, or an Internet-linked local network). The 
communications relevant to the present invention are handled by a web 
browser 57, which resides within computer 50 and operates the 

20 computer's display (e.g., video or liquid crystal) 60. Naturally, computer 
50 also contains various conventional components, i.e., system storage, 
an operating system and a graphical user interface, and a keyboard 
and/or position-sensing device (e.g., a mouse) for accepting input from 
the user. For convenience of presentation, these are not shown. 

25 Browser 57 contains functionality for locating and fetching, via 

network 55, web items (e.g., static pages or pages containing dynamic 
applets) identified by a URL, displaying these, executing applets, 
executing hyperlinks contained in web pages and selected by the user or 
invoked in an executing applet, and generally interpreting web-page 
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information. The web items ordinarily are contained in the web pages of 
one or more controllers 10t, 102, etc. As explained earlier, the web 
pages contain data, hyperlink addresses, transfer protocols and computer 
instructions defining applets, or links thereto. Browser 57 may be any of 
5 the numerous available web browsers, e.g!, NETSCAPE NAVIGATOR 
(supplied by Netscape Communications Corp.) or MOSAIC (different 
versions of which are available free of charge at a variety of web sites). 

In a vyorking system, the network interface 3d, 302, etc. of every 
controller in the system is constantly active and in communication with 

10 network 55, facilitating access by computer 50 to any controller-based 

web page(s) at any time. In this way, computer 50 can examine the data 
associated with any controller merely by specifying the appropriate URL 
of the controller's primary web page. The web page (and, preferably, an 
applet associated therewith) is copied to browser 57 and displayed along 

15 with the relevant, timely data. For example, the applet, executing on 
client computer 50, can autonomously access data from a web page 
different from the primary page the client user originally specified, all in a 
manner completely invisible to the user. Such access can be periodic or 
essentially continuous for data subject to rapid change. 

20 Naturally, the network accessibility of control data, particularly 

over the Internet, raises security issues. It may be desirable to equip 
controller-based web pages with a password access feature, whereby 
browser 57 or an executing applet must present a password before being 
accorded access to associated data. In addition, the data may be 

25 encrypted before being placed on the network. These functions are 
handled by communication module 37, which acts as a gatekeeper to 
web server module 45. Security-clearance functions are conventional 
and readily implemented by those skilled in the art. 
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Security becomes particularly important if the controller-based web 
pages allow client computer 50 not only to access data, but to modify it 
as well. For example, while "read-only" access to control data suffices 
to inform the client user of the state of a controlled machine or process, 
5 the user cannot, if limited to such access, influence the operation of the 
controller. It may prove desirable, therefore, to allow an appropriately 
authorized client to directly modify control parameters (which may, for 
example, be stored on a restricted-access web page) that determine the 
operation of the controller and, hence, the controlled machine or process. 

10 Indeed, a controller-based applet invoked by the user's interaction with 
one of the controller's web pages can permit the remotely situated client 
user to operate the controller hardware — for example, causing the 
controller to execute a reset routine that restarts automated equipment 
following shutdown, or causing the controller to operate in a step-by-step 

15 fashion for diagnostic purposes. 

It will therefore be seen that the foregoing represents a highly 
extensible and flexible approach to remote access to and presentation of 
controller information. The terms and expressions employed herein are 
used as terms of description and not of limitation, and there is no 
20 intention, in the use of such terms and expressions, of excluding any 

equivalents of the features shown and described or portions thereof, but 
it is recognized that various modifications are possible within the scope 
of the invention claimed. 
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CLAIMS 



1 
2 
3 
4 
5 
6 
7 
8 
9 

1 

2 
3 
4 
5 
6 

1 
2 
3 

1 
2 
3 



1 . A controller capable of interacting with a remotely located monitoring 
station, the controller comprising: 

a. means for gathering current video information relevant to a 
control function, the current video information being retrievable 
by the remotely located monitoring station; 

b. means for transmitting said current video information to said 
remotely located monitoring station; and 

c. means for causing the remotely located monitoring station to 
present the current video information in a predetermined format. 

2. The controller of claim 1 wherein said means for gathering current 
video information is a plurality of video cameras positioned to retrieve 
said current video information relevant to said control function connected 
such that at least one of said video cameras can be selected to display 
said current video information at said monitoring station in said 
predetermined format. 

3. The controller of claim 1 wherein said means for gathering current 
video information is at least one video camera having a selectable 
orientation and an image capture rate. 

4. The controller of claim 3 wherein said video camera is a digital video 
camera providing images for transmission to said monitoring station and 
display on said monitoring station in said predetermined format. 



1 
2 



5. The controller of claim 1 wherein said means for transmitting current 
video information includes a transmission medium coupled between said 
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3 controller and said remotely located monitoring station, said transmission 

4 medium including a computer network. 

1 6. The controller of claim 4 wherein said predetermined format in which 

2 said current video information is presented is periodically refreshed digital 

3 images. 



1 7. The controller of claim 4 wherein said predetermined format in which 

2 said current video information is presented is full motion video. 

1 8. The controller of claim 4 wherein said predetermined format in which 

2 said current video information is presented is a video display with a 

3 graphic frame inserted on one portion of said video display illustrating a 

4 selected control parameter. 

1 9. The controller of claim 1 further comprising: 

2 a. a source of comparison video information comprising at least 

3 one of historical video information and reference video information 

4 relevant to a control function; and 

5 b. means for causing the remotely located monitoring station to 

6 present said comparison video information in a predetermined format. 

1 10. The controller of claim 9 wherein said predetermined format in 

2 which said comparison video information is presented comprises side-by- 

3 side presentation of said current video information with said comparison 

4 video information. 

1 11. The controller of claim 10 wherein said predetermined format also 

2 includes a graphic frame inserted on one portion of said side-by-side 

3 presentation illustrating a selected control or comparison parameter. 
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1 12. The controller of claim 1 further comprising security means for 

2 preventing data interchange between the controller and an unauthorized 

3 user. 

1 13. An integrated control system comprising: 

2 a. at least one controller comprising: 

3 i. means for performing a control function; 

4 ii. means for gathering data and video information relevant 

5 to the control function; 

6 iii. computer storage means for storing (a) said data and 

7 video information and (b) instructions, associated with 

8 said data and video information, for causing a computer 

9 to present said data and video information in a 
10 predetermined format; and 

1 iv. means for facilitating data and video interchange with a 

12 remotely located computer; 

13 b. at least one monitoring computer comprising: 

14 i. means for facilitating data and video interchange with at 

15 least one selected controller to obtain therefrom the data, 

16 video information and the instructions; and 

17 ii. means for presenting the data and video information in 

18 the predetermined format. 

1 14. The system of claim 13 wherein the means for facilitating data and 

2 video interchange of the controllers and of the monitoring computer are 

3 connected by a computer network. 

1 15. The system of claim 13 wherein the means for facilitating data and 

2 video interchange and the means for presenting the data and video 

3 comprise a web browser configured to generate a visual display. 
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1 16. The system of claim 13 wherein the instructions cause the data and 

2 video to be visually displayed in an interactive user interface. 

1 17. The system of claim 13 wherein the controller and the monitoring 

2 computer are connected by way of the Internet. 

1 18. The system of claim 13 wherein said means for gathering video 

2 information relevant to said control function includes a bank of video 

3 cameras positioned to generate a plurality of images of said control 

4 system, and further comprising means for selecting any one of said video 

5 cameras to display a selected image of said control system. 

1 19. A controller capable of interacting with a remotely 

2 located computer, the controller comprising: 



3 a- means for gathering data relevant to a control 

4 function, the data being retrievable by the 

5 remotely located computer; 

6 b. computer storage means comprising instructions 

7 retrievable and executable by the remotely located 

8 computer, the instructions being associated with 

9 the data and causing the remotely located computer 
10 to present the data in a predetermined format. 



1 20. The controller of claim 19 further comprising a 

2 communication module for facilitating data interchange 

3 between the controller and a remotely located computer. 

1 21. The controller of claim 20 wherein the instructions 

2 cause the data to be visually displayed in an interactive 

3 user interface. 

1 22. The controller of claim 20 wherein the communication 

2 module connects to the Internet so as to make the 

3 controller a continuously active Internet node. 
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1 23. The controller of claim 19 wherein at least some of 

2 the data is resident on a different controller, the data- 

3 gathering means being configured to access and obtain the 

4 data from the different controller via a computer 

5 network . 

1 24/ The controller of claim 19 wherein at least some of 

2 the data is resident on a different controller, the 

3 instructions causing the remotely located computer to 

4 obtain the data from the different controller via a 

5 computer network. 

1 25. The controller of claim 19 wherein the data is 

2 continuously generated, the instructions causing the 

3 remotely located computer to continuously retrieve and 

4 present changing data. 

1 26. The controller of claim 20 wherein the communication 

2 module comprises security means for preventing data 

3 interchange between the controller and an unauthorized 

4 computer . 

1 27. An integrated control system comprising: 

2 a. at least one controller comprising: 

3 i. means for performing a control function; 

4 ii. means for gathering data relevant to the 

5 control function; 

6 iii. computer storage means for storing (a) the 

7 data and (b) instructions, associated with 

8 the data, for causing a computer to present 

9 the data in a predetermined format; and 

10 iv. means for facilitating data interchange 

11 with a remotely located computer; 

12 b. at least one monitoring computer comprising: 

13 i. means for facilitating data interchange 

14 with at least one selected controller to 
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15 obtain therefrom the data and the 

16 instructions; and 

17 ii. means for presenting the data in the 

18 predetermined format. 

1 28. The system of claim 27 wherein the means for 

2 facilitating data interchange of the controllers and of 

3 the monitoring computer are connected by a computer 

4 network „ 

1 29. The system of claim 27 wherein the means for 

2 facilitating data interchange and the means for 

3 presenting the data comprise a web browser configured to 

4 generate a visual display. 

1 30. The system of claim 27 wherein the instructions cause 

2 the data to be visually displayed in an interactive user 

3 interface. 

1 31. The system of claim 27 wherein the communication 

2 modules connect to the Internet, the communication 

3 modules of the controllers being continuously connected 

4 so as to make the controllers continuously active 

5 Internet nodes. 

1 32. The system of claim 2 7 wherein at least some of the 

2 data is resident on a plurality of controllers, the means 

3 for facilitating data interchange of the monitoring 

4 computer being configured to access and obtain the data 

5 from the controllers via a computer network. 

1 33. The system of claim 27 wherein at least someof the 

2 data is resident on a plurality of controllers, the 

3 instructions causing a monitoring computer to obtain the 

4 data from the controllers via a computer network. 
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1 34. The system of claim 27 wherein the data is 

2 continuously generated , the instructions causing a 

3 monitoring computer to continuously retrieve and display 

4 changing data. 

1 35. The system of claim 27 wherein the means for 

2 facilitating data interchange of the controllers comprise 

3 security means for preventing data interchange between 

4 the controllers and an unauthorized monitoring computer. 

1 3 6. A method of obtaining and presenting data associated 

2 with a control system, the method comprising: 

3 a. providing at least one controller comprising: 

4 i. means for performing a control function; 

5 ii. means for gathering data relevant to the 

6 control function; 

7 iii. means for storing (a) the data and (b) 

8 instructions , associated with the data, for 

9 causing a computer to present the data in a 

10 predetermined format; 

11 b. causing the at least one controller to perform 

12 the control function and to gather the data; 

13 c. causing a computer to access the data and execute 

14 the instructions, thereby presenting the data in a 

15 predetermined format. 

1 37. The method of claim 36 wherein at least some of the 

2 data is resident on a plurality of controllers, and 

3 further comprising the step of causing the computer to 

4 access and obtain the data from the controllers via a 

5 computer network. 

1 38. The method of claim 36 wherein at least some of the 

2 data is resident on a plurality of controllers, and 

3 further comprising the step of causing the computer to 

4 obtain the data from the controllers via a computer 

5 network . 
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1 39. The method of claim 36 wherein the data is 

2 continuously generated / the instructions causing the 

3 computer to continuously retrieve and display changing 

4 data from at least one controller. 

1 40. The method of claim 3 6 further comprising the step of 

2 preventing data interchange between the controllers and 

3 an unauthorized computer. 
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